瑞典专利SE1150216A1 Gesture controlled user interface

专利PDF首页>>瑞典专利

专利附录

专利说明

权利要求

类似技术

同族专利

引用文献

法律状态

优先权

专利摘要:
ONS/22/FEB/2012 16:59 Albihnslacco Si-:eà ^+469 i 0885 10 FAX Nr, :+46910885i0 S. 021 Abstract Förfarande, i ett datorsystem som innefattar en interaktiv displayyta, för att kontrollerauppvisande! av en användargränssnittsmeny, vilket förfarande innefattar följande: en meny-möjlighet visas upp i var och en av ett flertal aktiva displayställningar, varvid varje display-ställning befinner sig vid en av ett motsvarande flertal aktiva radiella ställningar som strålar utfrån en central ställning; rörelse påvisas hos en kontaktpunkt på den interaktiva dispiayytan;och den menymöjlighet som visas l var och en av displayställningarna förändras som respons på att den påvisade rörelsen hos kontaktpunkten är en sådan in mot eller ut från den centrala ställningen. [Figur 5]
公开号:SE1150216A1
申请号:SE1150216
申请日:2011-03-11
公开日:2012-05-06
发明作者:Nigel Pearce
申请人:Promethean Ltd；
IPC主号:

专利说明:

GESTURE CONTROLLED USER INTERFACE Field of the Invention The invention relates to interactive display surfaces,and particularly but not exclusively to touch-sensitiveinteractive display surfaces. The invention relates to the use of a gesture to control a user interface menu on an interactive display surface. The invention is particularly,but not exclusively, concerned with interactive displaysystems, such as used in classrooms in educational environments, incorporating interactive display systems.
Description of the Related Art Interactive display surfaces, such as touch-sensitivedisplay surfaces, are well-known in the art. In particular itis well-known ill the art to provide touch sensitive displaysurfaces on portable electronic devices, including hand-held devices such as mobile telephones.
Interactive display surfaces, including touch-sensitivesurfaces, are also known to be provided on large scaledisplays, such as in electronic whiteboards in educational classroom environments.
Interactive display surfaces allow a user to control anelectronic device via input contacts - such as touch inputs -at the surface. The user may select applications and menu options, and enter data, using such a surface.
With reference to Figure 1 there is illustrated anexemplary radial menu display of a touch-sensitive displaysurface. As illustrated in Figure 1, nine displayed activecircumference menu icon positions denoted by referencenumerals 1041 to 1049 are positioned about a central pointdenoted by reference numeral 100. Each displayed activecircumference menu icon position 1041 to 1049 is displayed as acircular graphical user icon (GUI). Each. displayed activecircumference menu icon. position 1041 to 1049 includes menuicon information, or a menu option, which in the example of Figure 1 is denoted by labels A to I in the respective circular positions denoted by reference numerals 1041 to 1041 A hand is denoted by reference numeral 102. In a touchsensitive display surface, the hand 102 is used to selectdisplayed Inenu icons, or more particularly a finger of thehand is used to select displayed menu icons. Thus thedisplayed active circumference menu icon positions 1041 to 1049are preferably sized to ensure that the finger of the hand 102can. be used to select one of the positions, without therebeing any ambiguity as to the position. being selected, forexample by avoiding the positions being located too close together.
To ensure that the menu icon positions are presented ofsufficient size to allow them to be selected by touch, withoutany ambiguity in the selection. process, and also to ensurethat the overall size of the displayed menu does not undulyconsume the display surface, there is a limit as to the numberof displayed active circumference menu icon positions 104which. may be displayed. In the example of Figure 1 nine active circumference menu icon positions are displayed, but in other arrangements a greater or fewer number of activecircumference menu icon positions may be displayed as appropriate.
In any arrangement, the number of displayed activecircumference menu icon positions may not be sufficient toallow all menu. options to be displayed simultaneously. Asnoted above, it may not be practical to increase the number ofdisplayed active circumference menu icon positions, as to doso would result in the positions being sized or located as topotentially result in the selection of an incorrect displayed icon.
As also noted above, increasing the overall size of themenu to increase the number of menu icon positions displayed may not be practical, as to do so would consume display space.
Consequently, the number of menu options displayed has tobe limited, in order to ensure that the displayed active circumference menu icon positions are sufficiently spaced.
It is an ainl of the invention. to provide an improvedtechnique for controlling the display of, and controlling theselection of options from, a radial menu displayed on an interactive display surface such as a touch-sensitive display.
Summary of the Invention In accordance with the invention there is provided amethod, in a computer system including an interactive displaysurface, of controlling the display of a user interface menu, the method comprising: displaying a menu option in each of a plurality of active display positions, each display position being located at one of a respective plurality of activeradial positions radiating from a central position; detectingmovement of a contact point on the interactive display surface; and changing the menu option displayed in each of the plurality of display positions in response to the detectedmovement of the contact point being inward or outward of thecentral position.
An active display position is preferably a displayposition in which the displayed menu option can be selected bycontact on the interactive display surface at the displayposition.Movement of a contact point is preferably detected independence on determining a movement from a first to a secondlocation on the surface, whilst maintaining contact with the surface.
The step of detecting movement of a contact point on theinteractive surface may include a heuristic for determiningthat the movement of the contact point corresponds to a radial gesture based on an angle of the detected movement with respect to a radius extending from the central point. In the heuristic a detected movement within a predefined angle of a radius may be determined to comprise a radial gesture.
The radial gesture may be determined as being an inward or an outward radial gesture in dependence on whether, respectively, the radial gesture is toward or away from the central point.
The method may further comprise the steps of: displayinga menu option in each of a plurality of inner displaypositions, each inner display position being associated withan active display position, each inner display position beinglocated at one of a respective plurality of inner radialpositions radiating from the central position, the innerradial positions being located a shorter distance from thecentral point than the respective active radial positions;changing the menu option displayed in each of the plurality ofactive display' positions to the Inenu. option. in each of theplurality of associated inner display positions in response tothe detected movement of the contact point being outward ofthe central position; and changing the menu option displayedin each of the plurality of inner display positions to themenu option in each of the plurality' of associated activedisplay positions in response to the detected movement of the contact point being inward of the central position.
The inner display positions are preferably' not activedisplay positions, and thus preferably do not represent menu options currently available for selection by a user.
The distance of each of the inner display positions fromthe central point is preferably less than the distance of each of the active display positions from the central point.
The method may further comprise the steps of: displayinga menu option in each of a plurality of outer displaypositions, each outer display position being located at one ofa respective plurality of outer radial positions radiatingfrom the central position, the outer radial portions being located a further distance from the central point than the išlx respective active radial position; changing the menu optiondisplayed in each of the plurality of active display positionsto the menu option. in each of the plurality' of associatedouter display positions in response to the detected movementof the contact point being inward of the central position; andchanging the menu option displayed in each of the plurality ofouter display' positions to the menu option. in each of theplurality of associated active display positions in responseto the detected movement of the contact point being outward of the central position.
The outer display positions are preferably not activedisplay positions, and thus preferably do not represent menu options currently available for selection by a user.
The distance of each of the outer display positions fromthe central point is preferably greater than the distance of each of the active display positions from the central point.
The method may further comprise the step of rotating amenu option displayed in each of the plurality of activedisplay positions in response to the detected movement of thecontact point being rotational movement about the central position.
The active circumference about a central position ispreferably not a displayed circumference, but represents anotional or geometric circumference about the central positionalong which the active display positions are displayed. In anarrangement in which the active display positions are circularicons, the active circumference may be a notional circumference about the central position, and the central point of each of the circular active display positions may be coincident with the notional circumference.
The menu options in each of the active display positionsmay represent a current set of menu options available for selection by a user.
The menu options in each of the inner display positionsand/or the outer display positions may represent a respectiveset of menu options which is available for selection by a userin response to the detected. movement of the contact pointbeing inward or outward of the central position such as torepresent a radial gesture.display surface is preferably an The interactive interactive display surface of an interactive display system.
The interactive display surface is preferably a touch-sensitive display surface.
In accordance with the invention there is furtherprovided a computer system associated with an interactive display surface, adapted to control the display' of a user interface menu, comprising: a menu display module adapted todisplay a menu option in each of a plurality of active displaypositions, each display' position. being located. at one of arespective plurality of active radial positions radiating fromabout a central position; a touch detection module adapted todetect movement of a contact point on the interactive displaysurface; the menu display module further being adapted tochange the menu option displayed in each of the plurality ofdisplay positions in response to the detected movement of the contact point being inward or outward of the central position.
The computer system may further include a heuristicmodule for determining that the movement of the contact pointcorresponds to a radial gesture based. on an angle of thedetected movement with respect to a radius extending from the central point.
The menu display module may be further adapted to displaya menu option in each of a plurality of inner displaypositions, each inner display position being associated withan active display position, each inner display position beinglocated at one of a respective plurality of inner radialpositions radiating from the central position, the innerradial positions being located. a shorter distance from thecentral point than the respective active radial positions;change the menu option displayed in each of the plurality ofactive display' positions to the menu. option. in each. of theplurality of associated inner display positions in response tothe detected nwvement of the contact point being outward ofthe central position; and change the menu option displayed ineach of the plurality of inner display positions to the menuoption in each of the plurality of associated active displaypositions in response to the detected movement of the contact point being inward of the central position.
The menu display module may be further adapted to displaya menu option in each of a plurality of outer displaypositions, each outer display position being located at one ofa respective plurality of outer radial positions radiatingfrom the central position, the outer radial positions beinglocated. a further distance fronl the central point than therespective active radial position; change the menu option displayed in each of the plurality of active display positions to the menu option in each. of the plurality of associatedouter display positions in response to the detected movementof the contact point being inward of the central position; andchange the menu option displayed in each of the plurality ofouter display positions to the menu option in each. of theplurality of associated active display positions in responseto the detected movement of the contact point being outward of the central position.
The computer system may further include a rotationalgesture recognition. module adapted to rotate a menu optiondisplayed in each of the plurality of active display positionson the active circumference in response to the touch detectionmodule detecting movement of the contact point being rotational movement about the central position.
Brief Description of the Figures The invention. is now described. by way of example with reference to the accompanying Figures in which: Figure 1 illustrates a radial menu of a user interface; Figure 2 illustrates an improvement to a radial menu ofuser interface in accordance with an embodiment of theinvention; Figure 3 illustrates outward radial gestures forcontrolling the radial menu of Figure 2 in an embodiment; Figure 4 illustrates a radial menu of a user interface inan embodiment; Figure 5 illustrates inward radial gestures for controlling the radial menu of Figure 4 in an embodiment; Figure 6 illustrates a radial menu of a user interface inan embodiment; Figure 7 illustrates inward and outward radial gesturesfor controlling the radial menu of Figure 6 in an embodiment; Figure 8 illustrates clockwise and counter-clockwiserotational gestures for controlling the radial menu of Figure2 in an embodiment; Figure 9 illustrates an adaptation of the radial menu ofFigure 2 following a rotational gesture in an embodiment; Figure 10 illustrates a process flow for implementing apreferred embodiment of the invention; Figure ll illustrates the implementation. of a computersystem for implementing a preferred embodiment of theinvention; and Figure 12 illustrates a preferred implementation of theinvention in an interactive display system in a classroom environment.
Description of Preferred Embodiments The invention is now described by way of exemplaryarrangements and embodiments. One skilled in the art willappreciate that the following description sets out examplearrangements for describing the invention and its operation,and does not represent restrictions on the scope of the claimed invention.
The invention. is described herein iii the context of aninteractive display surface being a touch-sensitive displaysurface. A particular advantage of a system incorporating atouch-sensitive display surface in which the invention and its embodiments may advantageously be used is described below with 11 reference to Figure 12. However the invention is not limitedto touch-sensitive display systems, or the exemplary system ofFigure 12. For example the invention could be utilised ininteractive display surface incorporating camera technology orelectromagnetic pointer technology for detecting a contact point at the interactive surface.
The invention may be advantageously incorporated in amulti-touch environment, that is a touch sensitive displaysurface which is adapted to detect multiple touch inputs -such. as inputs fronl different users - simultaneously. Anytouch inputs referred to in the following description may be provided by any one of a plurality of users.
The exemplary arrangement described hereinbelow is of aradial menu in which the menu options are distributed on acircumference around a central point. However the inventionis not limited to such a circular menu. The radial menu mayform, for example, a square shape rather than a circular shape.
With reference to Figure 2, there is illustrated animprovement in a displayed radial menu in accordance with anembodiment of the invention. It should be noted that in thefollowing description when the same reference numeral is usedin different Figures, this denotes the same feature appearing in different Figures.
With reference to Figure 2, the displayed activecircumference menu icon. positions 1041 to lO4n, respectivelycontaining menu information or menu options A to I, are displayed. The displayed active circumference menu icon 12 positions are each located on the circumference of a circleplotted about the central point 100. Each displayed activecircumference menu icon position is positioned along a radiusextending from the central point 100, and hence the displayed menu is termed a radial menu.
In addition, displayed inner circumference menu iconpositions 1031 to 1039, displaying menu information. or menuoptions J to R respectively, are additionally shown. Thedisplayed inner circumference menu icon positions 1031 to 1039are generally disposed on the circumference of a circleplotted around the central point 100, similar to the displayedactive circumference menu icon. positions 1041 to 1049, eachdisplayed inner circumference menu icon position beingpositioned along a radius extending from the central point lOO.
The displayed inner circumference menu icon positions 1031to 1039 are displayed within the circumference formed by thedisplayed active circumference menu icon positions 1041 to1041 Thus the radial distance of each inner circumferencemenu icon position is less than the radial distance of each active circumference menu icon position.
Further, the displayed inner circumference menu iconpositions 1031 to 1039 are displayed in a smaller size than thedisplayed active circumference menu icon positions 1041 to lO49.
Preferably' the inner circumference menu icon positions1031 to 1039 are not available for active selection, and are displayed in a faint or shadow format, such. that they are 13 visible to the user' but indicated. as not selectable by theuser. This is denoted in the Figures by the presentation ofthe displayed inner circumference menu icon positions 1031 to 1039 as circular positions having a dashed outline.
The displayed active circumference menu icon positions1041 to 1049 are available for user selection, and representactive menu options. These are displayed in a regular display format, denoted in the Figures by a solid outline.
The menu information or menu options J to R of thedisplayed inner circumference menu icon positions 1031 to 1039represent additional menu options to the menu options A to Iof the displayed active circumference menu icon positions 1041to 1049. However as mentioned above, the displayed innercircumference menu icon positions 1031 to 1039 are notselectable positions. The presentation of the additional menuinformation J to R in the inner circumference menu iconpositions 1031 to 1039 indicates to the user that additionalmenu options are available, other than those specifically provided in the displayed active circumference menu icon positions 1041 to 1041 The displayed inner circumference menu icon positions arepreferably not made available for selection due to their sizewhich, as set out in the background section above, may not permit reliable selection of the options.
In accordance with an embodiment of the invention, theset of menu information J to R may be moved from the displayedinner circumference menu icon positions 1031 to 1039 to the displayed active circumference menu icon positions 1041 to 1049 14 respectively, in dependence upon a radial gesture, as further described with reference to Figure 3.
In order to allow for the transfer of menu informationbetween the displayed active circumference menu icon positions and the displayed inner circumference menu icon positions, each active icon position 1041 to 1049 is associated with - or mapped to ~ inner icon position 1031 to 1039 respectively, With reference to Figure 3, a user may, by touch, provide an outward radial gesture such as any one of the gestures 106m 1062, 1063 of Figure 3. Each of the outward radial gestures 106 of Figure 3 generally represents a movement outward from the central point 100, although may not be exactly along the radius extending from the central point 100.
A heuristic is preferably provided for determining whether the movement associated with the gesture corresponds to a radial gesture, based on an angle of the gesture with respect to a radius extending from the central point 100. Aheuristic is an experience~based technique for learning. Aheuristic method comes to an optimal conclusion as quickly as possible. A heuristic is intended to gain computational performance or conceptual simplicity, potentially at the cost of accuracy or precision. In user interface interaction, heuristic evaluation is a usability~testing technique devised by expert usability consultants. In heuristic valuation, the user interface is reviewed by experts and its compliance to usability heuristic ~ broadly stated, characteristics of a good user interface, based on prior experience - and any violating aspects are recorded.
In a preferred arrangement, if the gesture is determinedto define a line of movement within a predefined angle of such a radius, it is determined to be a radial gesture.
A. radial gesture is one that appears to eliminate onepath from, or appears to converge toward a path on, a point;like the spokes of a hub from a bicycle wheel. A gesture ispreferably detected as a result of a contact point on thesurface being determined to move from a first to a secondlocation on the surface, whilst maintaining contact with thesurface. The movement may' be required to be of a minimumlength to be identified as a gesture. The movement, or eithercontact point, may be required to be coincident with a certainarea of the surface to be identified as a gesture. The gesture may be detected based on proximity to the surface rather than direct contact with the surface.
With. reference to Figure 4, following a radial gesturesuch as the gestures 1061 to 1061 of Figure 3, the menuinformation J to R is transferred to the respective displayedactive circumference menu icon. positions 1041 to 1049, fromwhich positions the menu information may be subsequentlyselected by a user. The transfer of the menu information isbased on the association of the positions 1031 to 1039 with the positions 1041 to 1049 As further illustrated in Figure 4, in a furtherarrangement responsive to such a gesture to transfer menuinformation from the displayed inner circumference menu iconpositions to the displayed active circumference menu iconpositions, the menu information previously included in the displayed active circumference menu icon positions 1041 to 1049 16 is moved to a corresponding set of respective displayed outercircumference menu icon positions 1051 to 1059. Thus therespective outer circumference menu icon positions 1051 to 1059are illustrated as containing the menu information options A to I following the outward radial gesture 106 of Figure 3.
In order to allow for the transfers of menu informationbetween the displayed active circumference menu icon positionsand the displayed outer circumference menu icon positions,each active icon position 1041 to 1049 is associated with - or mapped to - an outer icon position 1051 to 1059 respectively.
As illustrated. in Figure 4, the displayed outercircumference menu icon. positions 1051 to 1059 are disposedoutside the circumference of the displayed activecircumference menu icon positions 1041 to 1049. Thus theradial distance of each outer circumference menu icon positionis greater than the radial distance of each active circumference menu icon position.
Further the displayed outer circumference menu iconpositions 1051 to 1059 are preferably displayed i11 a largersize than the active circumference menu icon positions 1041 to 1049 .
As with the inner circumference menu icon positions 1031to 1039, the outer circumference menu icon positions 1051 to1059 preferably' do not represent active icons available forselection by the user, but represent additional menu optionswhich. may be moved into the active circumference menu iconpositions 1041 to 1049. They are preferably displayed in a faint or shadow format, as denoted by a dashed outline in the 17 Figures, to denote that they are not actively available for selection.
With reference to Figure 5, there is illustrated the useof inward radial gestures 1081 to 1083 to move the menu optioninformation A to I in the outer circumference menu iconpositions 1051 to 1059 into the respective active circumferencemenu icon positions 1041 to 1049. Illustrated in Figure 5 arethree inward radial gestures 1081 to 1083. As with the outwardradial gestures 106, the inward radial gestures 108 are notrequired to exactly traverse the radius into the central point100, but generally represent a gesture moving radially inwards towards the central point 100.
The heuristic discussed above is preferably used foridentifying a radial gesture. The detection of movement to beinterpreted as a gesture for an inward radial gesture may be the same as for an outward radial gesture, as discussed above.
Following an inward radial gesture, such as inward radialgestures 1081 to 1083 of Figure 5, the displayed informationreverts to the format illustrated in Figures 2 and 3, with themenu information. A to 12 displayed in the respective activecircumference menu icon positions 1041 to 1049, and the menuinformation J to R being displayed in the inner circumference menu icon positions 1031 to 1039 The examples described with reference to Figures 2 to 5illustrate an arrangement in which there is provided twolevels of menu information. A first level of menu information A to I may be considered to be a first set of menu options, 18 and a second level of menu information J to R may be considered to be a second set of menu options.
The principles as described hereinabove may' be furtherextended to additional sets of menu options. With respect toFigure 6, there is illustrated an arrangement in which menuinformation options are displayed in each. of the displayedinner circumference menu icon positions 1031 to 1039, each ofthe displayed active circumference menu icon positions 1041 to1049, and each of the displayed outer circumference menu icon positions 1051 to 1051 As illustrated in Figure 6, in this example the set ofmenu information A to I is displayed in the displayed outercircumference menu icon positions 1051 to 1059, which asdescribed above are not options available for selection by theuser, but represent a set of nænu information which may bepresented in the displayed active circumference menu iconpositions 1041 to 1049 responsive to an inward radial gesture 108 .
The displayed inner circumference menu icon positions 1031to 1039 display a set of menu information S txn Z and alpharespectively. Again, as noted above, the displayed innercircumference menu icon positions 1031 to 1039 do not containmenu information which is available for selection by the user,but contain menu information which may be transferred toactive circumference menu icon positions 1041 to 1049 responsive to an outward radial gesture 106.
The menu information options J to R are displayed in the displayed active circumference menu icon positions 1041 to 19 1049, and are available for selection by the user.
With reference to Figure 7, there is illustrated outward radial gestures 1064 and 1065 which may result in informationbeing transferred from the displayed inner circumference menu icon positions to the respective displayed active circumference menu icon. positions, and in turn information being transferred from the displayed active circumference menuicon positions to the displayed outer circumference menu icon positions.
Also illustrated in Figure '7 is inward radial gestures 1084 and 1085, which represent gestures which would result in the information displayed in the displayed outer circumference menu icon positions being transferred to the respective displayed active circumference menu icon positions, and similarly' the information. displayed in the displayed activecircumference menu icon positions being transferred to the displayed respective inner circumference menu icon positions.
It will be appreciated that the principles set outhereinabove may be extended to additional levels of menuinformation, such that additional displayed inner or outer circumference menu icon positions may be displayed.
It should also be understood that more than one set of displayed active circumference menu icon positions may bedisplayed.
Still further, the display of menu options in thedisplayed inner circumference menu icon positions and displayed active circumference menu icon positions represents a preferable implementation. In an alternative implementation only the menu content information currently occupying the displayed active circumference menu icon positions 1041 to 1049 may be displayed, but with the information therein being changed responsive to an outward radial gesture 106 or an inward radial gesture 108, in accordance with a next or previous set of menu content information options which is not otherwise displayed. That is, the inner and outer circumference menu icon positions may not be displayed.
As illustrated in Figure 8, in addition to the control of the menu using radial gestures, rotational gestures may also be used in order to control the menu. Figure 8 illustrates a displayed menu corresponding to the arrangement of Figure 2, and additionally showing example counter-clockwise rotational gestures 1101 to 1104, and example clockwise rotational gestures 1121 and 1122.
Responsive to a counter-clockwise rotational gesture 110 or* a clockwise rotational gesture 112, the menu information contained in the active circumference menu icon positions 1041 to 1049 may be rotated by a certain number of displayed positions. The amount of positions by which menu information is rotated may be dependent upon the length of the rotation gesture 110 or 112. In addition, if any information is displayed in the inner circumference menu icon positions 103 or the outer circumference menu icon positions 105, this information may be similarly rotated.
With reference to Figure 9, there is illustrated an example following za counter-clockwise rotational gesture 110the content such as gesture 1103 of Figure 8. As a result, 21 included in the displayed active circumference menu iconpositions 1041 to 1049 is rotated by two menu icon positions,such that the content information A to I is locatedrespectively in the displayed positions 1048 to 1047.Similarly the content information. J to R displayed in thedisplayed inner circumference menu icon positions is now displayed in the displayed positions 1038 to 1037 respectively.
A rotational gesture is preferably detected by applying a heuristic.
The operation of a process in accordance with theprinciples of the invention, as described with reference toFigures 2 to 9 is now further described with reference to the flow diagram of Figure 10.
In a first step 200, a first data sub-set is displayed inthe displayed active circumference menu positions 1041 to 104% This data sub-set represents a first set of menu information.
In a step 202 inputs at the interactive display surfaceare monitored, for detection of an input gesture. Followingdetection of an input gesture in step 202, an assessment is made in step 206 with respect to the gesture.
In step 206 it is determined whether a gesture hasalready been established, i.e. whether a process is inoperation as a result of an already detected gesture. If thatis the case, then the process moves to step 208 and it isdetermined whether the detected input gesture is in fact the current input gesture. If that is the case, in step 218 the 22 current manipulation as a result of the current input gestureis performed, and thereafter the process moves to step 202.
If in step 208 it is determined that the input gesturethat has been detected is not the current input gesture, then the process returns to step 202.
In step 206 if it is determined that no current gesturethen in step 204 a determination is made as to If the is established,whether the current input gesture is a rotate gesture.input gesture is determined to be a rotate gesture, then in step 210 the current gesture is set as a “rotate” gesture, and the current manipulation is set as “rotate data sub-set”. In step 218 the current manipulation. is then. performed, before the process reverts to step 202.
If in step 204 it is determined that the input gesture isdetermined which not a rotate gesture, then in step 212 it is whether the input gesture is an outward radial gesture, may also be considered to be a “larger” gesture. If it is determined that the input gesture is an outward radial gesture, then the process moves on to step 216, the current gesture is set to be “larger”, and the current manipulation is set to be “show next data sub-sets”. The process then moves on to step 218 to perform the manipulation, and then reverts to step 202.
If in step 212 it is determined that the input gesture is not an outward radial gesture, then in step 214 it is determined whether the gesture is an inward radial gesture, which may also be considered to be a “smaller gesture”. If in step 214 it is determined that the input gesture is an inward 23 radial gesture, then the process moves on to step 220, and the current gesture is set to be a “smaller” gesture, and the current manipulation is set to be to “show previous data sub- set”. The manipulation is then performed in step 218, before the process reverts to step 202.
If in step 214 it is determined that the input gesture isnot an inward radial gesture, then the process reverts to step202 to detect further input gestures. implementation of the As Inentioned above, the circular radial menu is only exemplary. The display positions need not be provided. an active, inner* or outer circumference. More generally the display positions are radial positions radiating from a central point. The plurality of active displaypositions are located at a plurality of active radialpositions radiating from the central point in a respectiveplurality of directions. The plurality of inner displaypositions are located at a plurality of inner radial positionsradiating from the central point in a respective plurality ofdirections. The inner radial positions are a shorter distance from the central point than the respective active radial positions. The inner radial positions are preferably locatedon the same radii as the respective active radial positions.The plurality of outer display positions are located at aplurality of outer radial positions radiating from the centralpoint in a respective plurality of directions. The outerradial positions are a further distance from the central pointthan the respective active radial positions. The outer radial positions are preferably located on the same radii as the respective active radial positions. 24 With reference to Figure 11, there is illustrated themain functional blocks of a computer system adapted toimplement the invention. One skilled in the art willappreciate that additional functional blocks other than thoseillustrated in Figure ll are required in order to implement anappropriate computer system, but the principle functionalblocks associated with the operation of the invention are illustrated.
As illustrated. in Figure 11, a touch-sensitive displaysystem 302 is provided which includes a touch-sensitivedisplay surface, and interfaces with a computer systemgenerally denoted by reference numeral 303. A displaycontroller 306 provides display inputs to the touch-sensitivedisplay systenl 302 on communication lines 310. A displaydriver 304 receives detected inputs at the touch~sensitivedisplay surface at the touch-sensitive display system 302 oncommunication lines 308. An internal communications bus 324interconnects the various functional components of thecomputer system 303. In addition to the display controller306 and the display driver 304, the computer system 303includes a processor 320, a memory 322, a touch detectionmodule 312, a radial gesture recognition (heuristic) module314, a rotational gesture recognition (heuristic) module 316, and a menu display module 318.
Each of the modules 312, 314, 316 and 318 is adapted toperform a functionality in the computer system to supportoperation of features of the invention and the preferredarrangements as set out herein. Data used in the processing of these functions may be stored in the memory 322, and the processing of the functions may be carried out under control of the processor 320.
Further with reference to Figure 12, there is illustrated an exemplary environment in which the principles of the present invention Inay' be utilised. in an interactive display system. Figure 12 illustrates an interactive display system generally denoted by reference numeral 400, including a touch~ sensitive display system 302, and a computer 408.
The touch~sensitive display system 302 includes a touch- sensitive display surface 402, on which is displayed graphical elements such as a menu 406 corresponding to the radial menu described herein in various embodiments. Also illustrated in Figure 12 is a hand 404 of a user being used at the touch- sensitive display surface 402 to provide inputs.
The computer 408 is connected to the touch~sensitive display system 302 via a connection 416, which may be wireless or wired. Computer software including applications running on the computer system 408 control the display of graphical information. on the touch-sensitive display surface 402, and are controlled by inputs detected at the touch-sensitive The computer system 408 may be providedwhich display surface 402. with its own monitor 410, may display the same information. as displayed. on the interactive display surface 402 or different information. As illustrated in Figure 12, the computer system 408 may also be connected to other typessuch as a mouse of input device, input device 412 and a keyboard input device 414, and receive and process inputs from such devices. 26 An interactive display system 400 as illustrated inFigure 12 may be provided in a classroom environment foreducational purposes. The touch-sensitive display system 302may be provided as a large vertical display surface, which isviewable by a large number of students in a classroom. Theprovision of touch inputs at the touch-sensitive displaysurface 402 may be guovided kår a teacher or students in a classroom.
Figure 12 represents only one exemplary implementation ofthe invention. The touch-sensitive display systenl 302 mayprovide a touch-sensitive display surface 402 which isorientated in a direction other than a 'vertical direction, such as a horizontal surface.
The touch~sensitive display system 302 may also beprovided as a small-scale device, such as a portable or hand~ held device, with a touch-sensitive display surface.
Further, and as noted hereinabove, the invention is notlimited in its applicability to touch-sensitive displaysystems, and in general is applicable to an interactive display system.
The interactive display surface may be an admissivesurface, or may be a surface onto which images are projected.The invention is not limited to any particular type oftechnology for an interactive display surface, or moreparticularly to any particular type of technology for a touch- sensitive display surface. 27 As will be clear to one skilled in the art, numerousembodiments of interactive display systems may be used topractice the present invention, e.g. to run the methods described herein as part of an interactive program stored onstorage media such as computer memory storage or peripheral memory storage which is accessible by a computer, and the above description of an exemplary application in an interactive display system is not intended to limit the breadth of coverage provided by the invention. For example,the program software for practising the present invention maybe stored on a disk (such as a CD or other data storagemedia), may be downloaded into a computer's memory to be run,or may run from disk. will various to the One skilled in the art appreciate modifications and adaptations invention. as describedhereinabove in order to implement the invention in alternativescenarios, without diverting from the scope of the inventionas claimed. Embodiments described. herein. are not mutuallyexclusive, and aspects of the embodiments described herein may be combined in full or in part.

权利要求:
Claims (18)
[1] 1. :l. A method, in a computer system including an interactivedisplay surface, of controlling the display of a user interface menu, the method comprising:displaying a menu option in each of a plurality of active display positions, each display position being located at one of a respective plurality of active radial positions radiating from a central position; detecting movement of a contact point on the interactive display surface; and changing the menu option displayed in each of the plurality of display positions in response to the detected movement of the contact point being inward or outward of the central position.
[2] 2. The method of claim 1 wherein the step of detecting movement of the contact point on the interactive surface includes a heuristic for determining that the movement of the contact point corresponds to a radial gesture based on an angle of the detected movement with respect to a radiusextending from the central point.
[3] 3. The method of claim 2 wherein in the heuristic a detected movement within a predefined angle of a radius is determinedto comprise a radial gesture.
[4] 4. The method of claim 2 or claim 3 further comprisingdetermining the radial gesture as being inward or outward inthe radial gesture is dependence on whether, respectively, toward or away from the central point. 29
[5] 5. The method of any preceding claim further comprising thesteps of: displaying a menu option in each of a plurality of innerdisplay positions, each inner display position beingassociated with an active display position, each inner displayposition. being located at one of a respective plurality ofinner radial positions radiating from the central position,the inner radial positions being located. a shorter distancefrom the central point than the respective active radialpositions; changing the menu option displayed in each of theplurality of active display positions to the menu option ineach of the plurality of associated inner display positions inresponse to the detected movement of the contact point beingoutward of the central position; and changing the menu option displayed in each of theplurality' of inner display' positions to the menu. option ineach of the plurality of associated active display positionsin response to the detected movement of the contact point being inward of the central position.
[6] 6. The method of any preceding claim further comprising thesteps of: displaying a menu option in each of a plurality of outerdisplay positions, each outer display position being locatedat one of a respective plurality' of outer radial positionsradiating from the central position, the outer radialpositions being located a further distance from the centralpoint than the respective active radial position; changing the menu option displayed in each of theplurality of active display positions to the menu option in each of the plurality of associated outer display positions in response to the detected movement of the contact point beinginward of the central position; and changing the menu option displayed in each of the plurality of outer display positions to the menu. option. ineach of the plurality of associated active display positionsin response to the detected movement of the contact point being outward of the central position.
[7] 7. The method of any preceding claim further comprising thestep of: rotating the menu option displayed in each of theplurality of active display positions in response to thedetected movement of the contact point being rotationalmovement about the central position.
[8] 8. The method of any one of claims 1 to 4 wherein the menu options in each of the active display positions represent a current set of menu options available for selection by a user.
[9] 9. The method of any preceding claim in which theinteractive display surface is a touch-sensitive displaysurface.
[10] 10. A. computer program adapted to perform, when run on a computer, the method according to any one of claims 1 to 9.
[11] 11. A computer program product for storing computer program code which, when run on a computer, performs the method of any one of claims 1 to 9.
[12] 12. A computer system associated with an interactive display surface, adapted for controlling the display of a user 31 interface menu, the computer system comprising:a menu display module adapted to display a menu option in each of a plurality of active display positions, each display position. being located. at one of a respective plurality ofactive radial positions radiating from a central position; and a touch detection module adapted to detect movement of acontact point on the interactive display surface; wherein. the menu display' module is further adapted. to change the menu option displayed in each of the plurality ofdisplay positions in response to the detected movement of the contact point being inward or outward of the central position.
[13] 13. The computer system of claim 12 further comprising a radial gesture recognition module adapted to detect movement of the contact point on the interactive surface as corresponding to a radial gesture, based on an angle of the detected movement with respect to a radius extending from the central point.
[14] 14. The computer system of claim 12 or claim 13 wherein the menu display module is further adapted to: display a menu option in each of a plurality of inner display positions, each inner display position being associated with an active display position, each inner displayposition. being located. at one of a respective plurality' ofinner radial positions radiating from the central position,the inner radial positions being located. a shorter distance from the central point than the respective active radial positions;change the menu option displayed in each of the pluralityof active display positions to the menu option in each of the plurality of associated inner display positions in response to 32 the detected movement of the contact point being outward ofthe central position; and change the menu option displayed in each of the pluralityof inner display positions to the menu option in each of theplurality of associated active display positions in responseto the detected movement of the contact point being inward of the central position.
[15] 15. The computer system of any one of claims 12 to 14 whereinthe menu display is further adapted to: display a nænu option in each of a gﬂurality of outerdisplay positions, each outer display position being locatedat one of a respective plurality of outer radial positionsradiating from the central position, the outer radialpositions being located a further distance from the centralpoint than the respective active radial position; change the menu option displayed in each of the pluralityof active display positions to the menu option in each of theplurality of associated outer display positions in response tothe detected movement of the contact point being inward of thecentral position; and change the menu option displayed in each of the pluralityof outer display positions to the menu option in each of theplurality of associated active display positions in responseto the detected movement of the contact point being outward of the central position.
[16] 16. The computer system of any one of claims 12 to 15 furthercomprising a rotational gesture recognition module adapted to:detect movement of the contact point being rotational movement about the central position, 33 the menu display module being further adapted to rotatethe menu option displayed in each of the plurality of activeon the active circumference in display positions response thereto.
[17] 17. The computer systenl of any one of claims 12 to 16 in which the interactive display surface is a touch-sensitive display surface.
[18] 18. An interactive display system including a computer system according to any one of claims 12 to 17.

类似技术:

公开号 | 公开日 | 专利标题

SE1150216A1|2012-05-06|Gesture controlled user interface

JP6649947B2|2020-02-19|Classifying touch input as unintentional or intentional

US10917455B2|2021-02-09|File transfer display control method and apparatus, and corresponding terminal

US20170131835A1|2017-05-11|Touch-Sensitive Bezel Techniques

US20150227231A1|2015-08-13|Virtual Transparent Display

US9537908B2|2017-01-03|Collaborative mobile interaction

US20130012313A1|2013-01-10|Tablet computer game device

CN108369479A|2018-08-03|Target selection on small form factor display

CN107885823B|2020-06-02|Audio information playing method and device, storage medium and electronic equipment

AU2015306878B2|2019-01-17|Phonepad

CN106716300A|2017-05-24|Gesture-based access to a mix view

WO2013138675A1|2013-09-19|Input data type profiles

US10101900B2|2018-10-16|Information processing device and method of processing information

US9035886B2|2015-05-19|System and apparatus for a multi-point touch-sensitive sensor user interface using distinct digit identification

EP3180683A1|2017-06-21|Direct access application representations

CN102981790B|2016-08-10|Display packing, terminal unit and multi-terminal equipment system

CN106201452A|2016-12-07|Present the device of window, the method and apparatus presenting user interface

CN111338495A|2020-06-26|Method and device for determining touch point

JP2017181997A|2017-10-05|Learning support program, learning support server device and learning support method

JP6391221B2|2018-09-19|Information processing apparatus, information processing method, and program

CN104346031A|2015-02-11|Display method and electronic equipment

US20200387640A1|2020-12-10|Securely entering sensitive information using a touch screen device

CN107463315B|2021-07-16|Information processing method and electronic equipment

US20190034069A1|2019-01-31|Programmable Multi-touch On-screen Keyboard

JP2020533706A|2020-11-19|How to steer virtual objects, devices and storage media

同族专利:

公开号 | 公开日

US10061477B2|2018-08-28|

US20140298264A1|2014-10-02|

US9223474B2|2015-12-29|

GB2485218A|2012-05-09|

WO2012059596A1|2012-05-10|

GB201018765D0|2010-12-22|

US20160139745A1|2016-05-19|

引用文献:

公开号 | 申请日 | 公开日 | 申请人 | 专利标题

US5689667A|1995-06-06|1997-11-18|Silicon Graphics, Inc.|Methods and system of controlling menus with radial and linear portions|

US6448987B1|1998-04-03|2002-09-10|Intertainer, Inc.|Graphic user interface for a digital content delivery system using circular menus|

GB0201074D0|2002-01-18|2002-03-06|3G Lab Ltd|Graphic user interface for data processing device|

US7663605B2|2003-01-08|2010-02-16|Autodesk, Inc.|Biomechanical user interface elements for pen-based computers|

US20040221243A1|2003-04-30|2004-11-04|Twerdahl Timothy D|Radial menu interface for handheld computing device|

US7600201B2|2004-04-07|2009-10-06|Sony Corporation|Methods and apparatuses for viewing choices and making selections|

US7644372B2|2006-01-27|2010-01-05|Microsoft Corporation|Area frequency radial menus|

US7676763B2|2006-02-21|2010-03-09|Sap Ag|Method and system for providing an outwardly expandable radial menu|

US8930834B2|2006-03-20|2015-01-06|Microsoft Corporation|Variable orientation user interface|

US7509348B2|2006-08-31|2009-03-24|Microsoft Corporation|Radially expanding and context-dependent navigation dial|

NL2000621C2|2007-05-01|2008-11-04|Meeteren Albertus Petrus Georg|Device for editing entered data.|

EP2017707B1|2007-07-06|2017-04-12|Dassault Systèmes|Widget of graphical user interface and method for navigating amongst related objects|

JP2010533336A|2007-07-11|2010-10-21|ユイ・ジン・オ|Data input device using finger motion sensing and input conversion method using the same|

KR100973354B1|2008-01-11|2010-07-30|성균관대학교산학협력단|Device and method for providing user interface of menu|

US7941765B2|2008-01-23|2011-05-10|Wacom Co., Ltd|System and method of controlling variables using a radial control menu|

CN101667091A|2008-05-15|2010-03-10|杭州惠道科技有限公司|Human-computer interface for predicting user input in real time|

US8245156B2|2008-06-28|2012-08-14|Apple Inc.|Radial menu selection|

DE102008038897A1|2008-08-13|2010-02-18|Deutsche Telekom Ag|Mobile phone with menu navigation on the screen|

US20100185985A1|2009-01-19|2010-07-22|International Business Machines Corporation|Managing radial menus in a computer system|

US9383897B2|2009-01-29|2016-07-05|International Business Machines Corporation|Spiraling radial menus in computer systems|

US8549432B2|2009-05-29|2013-10-01|Apple Inc.|Radial menus|

US8578295B2|2009-09-16|2013-11-05|International Business Machines Corporation|Placement of items in cascading radial menus|KR20140144320A|2013-06-10|2014-12-18|삼성전자주식회사|Method and apparatus for providing user interface in electronic device|

US20140380206A1|2013-06-25|2014-12-25|Paige E. Dickie|Method for executing programs|

US20150121314A1|2013-10-24|2015-04-30|Jens Bombolowsky|Two-finger gestures|

JP6176731B2|2014-03-11|2017-08-09|株式会社コナミデジタルエンタテインメント|GAME MANAGEMENT DEVICE, GAME SYSTEM, AND PROGRAM|

KR101488662B1|2014-07-31|2015-02-04|스타십벤딩머신 주식회사|Device and method for providing interface interacting with a user using natural user interface device|

KR102302353B1|2014-07-31|2021-09-15|삼성전자 주식회사|Electronic device and method for displaying user interface thereof|

US10310705B2|2014-12-05|2019-06-04|Entit Software Llc|Menu display control|

KR101767070B1|2016-04-21|2017-08-10|현대자동차주식회사|Vehicle, and control method for the same|

US20180081498A1|2016-09-16|2018-03-22|Google Inc.|Systems and methods for a touchscreen user interface for a collaborative editing tool|

CN111625158A|2020-05-22|2020-09-04|京东方科技集团股份有限公司|Electronic interactive panel, menu display method and writing tool attribute control method|

法律状态:
2015-05-26| NAV| Patent application has lapsed|

优先权:

申请号 | 申请日 | 专利标题

GB1018765.6A|GB2485218A|2010-11-05|2010-11-05|A method of navigating radial menu options|

[返回顶部]